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Objectives: To examine the current status of hospital information systems (HIS), analyze the effects of Electronic Medical 
Records (EMR) and Clinical Decision Support Systems (CDSS) have upon hospital performance, and examine how manage- 
ment issues change over time according to various growth stages. Methods: Data taken from the 2010 survey on the HIS 
status and management issues for 44 tertiary hospitals and 2009 survey on hospital performance appraisal were used. A chi- 
square test was used to analyze the association between the EMR and CDSS characteristics. A t-test was used to analyze the 
effects of EMR and CDSS on hospital performance. Results: Hospital size and top management support were significantly as- 
sociated with the adoption of EMR. Unlike the EMR results, however, only the standardization characteristic was significant- 
ly associated with CDSS adoption. Both EMR and CDSS were associated with the improvement of hospital performance. The 
EMR adoption rates and outsourcing consistently increased as the growth stage increased. The CDSS, Knowledge Manage- 
ment System, standardization, and user training adoption rates for Stage 3 hospitals were higher than those found for Stage 2 
hospitals. Conclusions: Both EMR and CDSS influenced the improvement of hospital performance. As hospitals advanced to 
Stage 3, i.e. have more experience with information systems, they adopted EMRs and realized the importance of each man- 
agement issue. 
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I. Introduction 

Hospital information systems (HIS) are being increasingly 
adopted by hospitals with the evolution of information 
technology (IT). The effective use of HIS reduces costs and 
improves patient care in the healthcare industry. According 
to a nationwide survey on HIS development in 2005 [1], al- 
most all Korean tertiary hospitals were equipped with Com- 
puterized Provider Order Entry (CPOE) System, Picture 
Archiving and Communication System, insurance claims by 
Electronic Data Interchange, and admission/ discharge/trans- 
fer. However, only 9 hospitals (21.43%) had adopted Elec- 
tronic Medical Record. These systems fall into the category 
of transaction processing systems (TPS), which are focused 
on reducing the waiting time for outpatients and length of 
hospital stay, and increasing hospital revenues [2] . 
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Unlike TPS, decision support systems (DSSs) are focused 
on improving the quality of decisions made by doctors and 
managers. Examples of DSSs are Clinical DSS (CDSS) for 
diagnosing diseases or prescribing medicine and Knowledge 
Management Systems (KMS) for financial management and 
marketing analysis. CDSS is denned as: 'providing clinicians 
or patients with computer-generated clinical knowledge 
and patient-related information, intelligently filtered or 
presented at appropriate times, to enhance patient care [3]. 
DSSs are generally integrated with a data warehouse, which 
is a comprehensive data repository of decision-oriented 
information. According to the 2005 survey, only a few hos- 
pitals had adopted DSSs and data warehouse, perhaps due 
to the following underlying barriers. Unlike TPS, DSSs are 
not easily adopted by hospitals due to difficulties in justify- 
ing their outcome and economic return. Moreover, their use 
is not compulsory. That is, doctors do not rely on CDSS to 
diagnose or prescribe medicine and planning staffs are not 
required to use KMS to analyze the hospital market or cus- 
tomer behavior. Since DSSs can be more easily developed if 
there is sound IT infrastructure such as data warehouse or 
EMR, the increasing adoption of such infrastructure by hos- 
pitals necessitates an examination of KMS adoption. 

The Ministry of Health and Social Welfare has launched 
a hospital performance evaluation project since 2004 in an 
effort to improve the quality of hospital services and patient 
management. All hospitals have to be evaluated every three 
years in the areas such as clinical care, quality of care, clini- 
cal information, emergency care, lab, and drug information 
[4]. While several studies have analyzed the effects of HIS on 
patient waiting time, length of stay, and medication errors, 
no study has been conducted to examine the effects of HIS 
on hospital performance in Korea. 

IT has also created various management issues for hospi- 
tals. EMR has changed workflow processes, resulting in the 
reduction of jobs and changes in the roles of key players 
such as physicians, nurses, and administrative staffs. Prob- 
lems have arisen due to the lack of system knowledge and 
increased workloads for physicians and nurses as they have 
to manually enter all of their orders into the system. In the 
study on the barriers and solutions for use of EMR, Miller 
and Sim [5] found that underlying barriers for EMR were: 
difficulties with technology, complementary changes, and 
physicians' attitudes. Kim et al. [6] and Kwak et al.[7] con- 
ducted surveys on key management issues for Korean HIS 
in 1999 and 2006 by targeting hospital IT managers using 
three-round Delphi surveys. Key management issues identi- 
fied by two surveys were: top management, standardization, 
regulations on EMR, user training, outsourcing, security 
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policy, and information strategy planning. 

IS are greatly affected by the rapid development of IT. Gib- 
son and Nolan [8] categorized the stages in the growth of IS 
into four stages from initiation to maturity as IT changes. 
They also recommended how each stage can be applied, as 
well as management issues that can emerge in each develop- 
mental stage. Nolan [9] introduced a six-stage model theory, 
which later expanded further into nine stages. Since Nolans 
stages of growth were introduced three decades ago, several 
revisions have been made to the model. Earl [10] applied 
the stages of growth model for e-business. Earl proposed the 
six-stage model for e-business that corporations are likely 
to experience. Gottschalk [11] has linked the information 
technology support for knowledge management in law firms 
to four stages of growth. This study analyzed the temporal 
changes in HIS development activities and management is- 
sues from the very beginning of the HIS implementation in 
order to examine whether Nolans stage theory holds for a 
hospital setting. 

The study purposes were to examine the current status of 
HIS, analyze the effects of EMR and CDSS on hospital per- 
formance, and examine how management issues change ac- 
cording to the growth stages. 

II. Methods 

1. Subjects 

HIS adoption status and management issues were obtained 
from a survey conducted for all 44 tertiary hospitals in Ko- 
rea from October 1 to 30, 2010. Hospital performance scores 
were obtained from the hospital performance appraisal sur- 
vey conducted by the Korea Health Industry Development 
Institute in 2009 [4]. 

2. Methods 

The association between the adoption of EMR/CDSS and 
hospital characteristics were analyzed by chi-square test. The 
effect of EMR/CDSS on hospital performance was analyzed 
by t-test. The hospital performance score was obtained by 
adding performance scores from six areas related to EMR/ 
CDSS [4] : clinical care, quality of care, clinical information, 
emergency care, lab, and drug information. Statistical analy- 
sis was performed by the Statistical Analysis System (SAS 
ver. 9.2, SAS Institue, Cary, NC, USA). 

In order to examine the temporal changes in HIS devel- 
opment activities and management issues, hospitals were 
grouped into one of three growth stages based on the year of 
HIS initiation: 1996-2010 (stage 1), 1986-1995 (stage 2), and 
before 1986 (stage 3). Specifically, this study surveyed the 
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hospitals in each stage to determine exactly which had more 
advanced HIS applications (e.g., EMR, CDSS, and KMS) and 
more mature management policies (e.g., top management 
support, standardization, user training, and out-sourcing). 
According to the Nolans stage theory, the hospitals in stage 
3 are assumed to have more advanced HIS applications and 
more mature management policies that the hospitals in stag- 
es 1 and 2. 

III. Results 

1. Status of HIS Adoption 

As seen in Table 1, every hospital had adopted CPOE. The 
adoption rate of EMR had greatly increased from 21.4% 
in 2005 to 77.3% in 2010. Compared to adoptions in 2005, 



Table 1. Adoption of hospital information systems in 2005 and 
2010 





2005 (%>) 


2010 (°/o) 


Application systems 


Computerized Provider Order Entry 


97.6 


100.0 


Electronic Medical Record 


21.4 


77.3 


Clinical Decision Support System 




27.3 


Knowledge Management System 


7.5 


29.4 


Data warehouse 


14.6 


21.9 



adoption of DSSs had also greatly increased in 2010. The 
adoption rate for CDSS was 27.3%. Adoption rates for DSS 
for management, KMS was 29.4%. None of these DSSs had 
been implemented in 2005. 21.9% of the hospitals had also 
adopted the data warehouse. 

2. Association of Hospital Characteristics and the Adop- 
tion of EMR 

As seen in Table 2, hospital size and top management sup- 
port were significantly associated with EMR adoption. The 
percentage of EMR adoption increased with increasing 
hospital size. With strengthening top management support, 
the percentage of EMR adoption also increased since EMR 
adoption requires large capital investment. While the other 
characteristics (ownership, location, and standardization) 
were not significantly associated with the EMR adoption, 
foundation-owned hospitals located in Seoul and other met- 
ropolitan areas, and hospitals that had adopted standardiza- 
tion had higher EMR adoption rates. 

3. Association of Hospital Characteristics and the Adop- 
tion of CDSS 

As seen in Table 3, only standardization was significantly as- 
sociated with CDSS adoption. Standardization refers to the 
hospitals that had adopted standard terminology to develop 
EMR or CDSS. Eight hospitals (66.7%) developed CDSS 
by using standard terminologies. Adoption of CDSS were 



Table 2. Characteristics of Electronic Medical Record (EMR) adoption 



Characteristics 


Category - 


Adoption of EMR 
Yes No 


Total 


x 2 


p- value 


Hospital size 


Less than 801 


10 (28.57) 


3 (33.33) 


13 (29.55) 


0.078 


0.780 




Greater than 800 


25 (71.43) 


6 (66.67) 


31 (70.45) 






Ownership 


Foundation 


7 (20.00) 


0 


7 (15.9) 


2.207 


0.331 




University 


24 (68.57) 


8 (88.89) 


32 (72.7) 








Public 


4 (11.43) 


1 (11.11) 


5(11.4) 






Location 


Seoul 


13 (37.14) 


3 (33.33) 


16 (36.4) 








Metropolitan 


12 (34.29) 


1 (11.11) 


13 (29.5) 


2.859 


0.239 




Province 


10 (28.57) 


5 (55.56) 


15 (34.1) 






Top management support 


Yes 


32 (94.12) 


6 (75.00) 


38 (90.48) 


2.746 


0.097 




No 


2 (5.88) 


2 (25.00) 


4 (9.52) 






Outsourcing 


Yes 


22 (68.75) 


6 (84.71) 


28 (71.79) 


0.816 


0.366 




No 


10 (31.25) 


1 (14.29) 


11 (28.21) 






Standardization 


Yes 


14 (41.18) 


2 (25.00) 


16 (38.10) 


0.718 


0.396 




No 


20 (58.82) 


6 (75.00) 


26 (61.90) 







Values are presented as number (%). 
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Table 3. Characteristics of Clinical Decision Support System (CDSS) adoption 



Adoption of EMR and DSSs 



Adoption of CDSS 



Characteristics 


Category 


Yes 


No 


Total 


x' 


p- value 


Hospital size 


Less than 801 


2 (15.38) 


11 (35.48) 


13 (29.55) 


1.777 


0.182 




Greater than 800 


11 (84.62) 


20 (64.52) 


31 (70.45) 






Ownership 


Foundation 


3 (23.08) 


4 (12.90) 


7 (15.91) 








University 


8 (61.54) 


24 (77.42) 


32 (72.73) 


1.176 


0.555 




Public 


2 (15.38) 


3 (9.68) 


5 (11.36) 






Location 


Seoul 


7 (35.85) 


9 (29.03) 


16 (36.36) 








Metropolitan 


2 (15.38) 


11 (35.48) 


13 (29.55) 


2.862 


0.239 




Province 


4 (30.77) 


11 (35.48) 


15 (34.09) 






Top management support 


Yes 


11 (91.67) 


27 (90.00) 


38 (90.48) 


0.027 


0.868 




No 


1 (8.33) 


3 (10.00) 


4 (9.52) 






Standardization 


Yes 


8 (66.67) 


8 (26.67) 


16 (38.10) 


5.815 


0.015 




No 


4 (33.33) 


22 (73.33) 


26 (61.90) 






Values are presented as number (%). 












Table 4. Adoption of standard terminology by EMR and CDSS 


Table 5. Effects of EMR/CDSS adoption on hospital performance 


EMR CDSS 




No. 


Performance score 


f p-value 


Yes 


No Yes 


No 


EMR Not adopted 9 


33.2 ± 5.0 


1.09 0.786 


SNOMED 9 (64.3) 


0 6 (75.0) 


2 (25.0) 


Adopted 


35 


36.3 ± 4.8 




UMLS 2 (14.3) 


0 1 (12.5) 


1 (12.5) 


CDSS Not adopted 31 


34.9 ± 4.7 


1.14 0.739 


ICNP 2 (14.3) 


1 (50.0) 1 (12.5) 


2 (25.0) 


Adopted 


13 


37.3 ± 5.1 




Miscellaneous 1 (7.1) 


1 (50.0) 0 


3 (37.5) 


EMR: Electronic Medical Record, CDSS: Clinical Decision Sup- 


Total 14 (100.0) 


2 (100.0) 8 (100.0) 


8 (100.0) 


port System. 









Values are presented as number (%). 

EMR: Electronic Medical Record, CDSS: Clinical Decision Sup- 
port System, SNOMED: Systematized Nomenclature of Medi- 
cine, UMLS: Unified Medical Language System, ICNP: Interna- 
tional Classification of Nursing Practice. 



higher for hospitals with over 800 beds, foundation-owned 
hospitals, public hospitals, and hospitals located in Seoul 
than the hospitals that did not adopt CDSS. 



5. Effects of EMR/CDSS on Hospital Performance 

The EMR-adopted hospitals had higher performance scores 
than those hospitals that had not adopted EMR although 
difference was not statistically significant (Table 5). Similarly, 
those hospitals that had adopted CDSS had higher perfor- 
mance scores than those that had not adopted CDSS. These 
findings suggest that both EMR and CDSS influenced the 
improvement of hospital performances. 



4. Types of Standard Terminology According to the 
Adoption of EMR and CDSS 

As seen in Table 4, three types of standard clinical terminol- 
ogy were used by 14 (29.5%) hospitals. Systematized No- 
menclature of Medicine-Clinical Terms (SNOMED-CT) was 
utilized by the majority of hospitals. Nine hospitals (64.3%) 
used it to develop EMR and eight hospitals (75%) used it 
to develop CDSS. Two hospitals used Unified Medical Lan- 
guage System (UMLS) and thee hospitals used International 
Classification of Nursing Practice (ICNP). 



6. Analysis of Management Issues with Growth Stages 

Adoption rates of EMR and outsourcing consistently in- 
creased as growth stage increases although the association 
between the two factors was not statistically significant; 
hospitals are likely to adopt EMR and outsource as they 
have more experience of implementing information systems 
(Table 6). Hospitals in stage 3 also had the highest adoption 
rates of KMS and user training. On the other hand, hospitals 
ins 1 had the highest adoption rates of CDSS and standard- 
ization. 
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Table 6. Adoption of hospital information systems and management issues by the growth stage 





AHnntinn 
nuuu Liu 1 1 


Stage 1 
(1995>) 


Stage 2 
(1986-1995) 


Stage 3 
(<1986) 


Total 


2 

X 


n-V3 1 1 IP 


EMR 


Yes 


6 (75.0) 


16 (80.0) 


12 (85.7) 


34 (81.0) 


0.40 


0.81 




No 


2 (25.0) 


4 (20.0) 


2 (14.3) 


8 (19.0) 






CDSS 


Yes 


4 (50.0) 


3 (15.0) 


5 (35.7) 


12 (28.6) 


3.95 


0.13 




No 


4 (50.0) 


17 (85.0) 


9 (64.3) 


30 (71.4) 






KMS 


Yes 


2 (25.0) 


3 (15.0) 


6 (42.9) 


11 (26.2) 


3.31 


0.19 




No 


6 (75.0) 


17 (85.0) 


8 (57.1) 


31 (73.8) 






Standardization 


Yes 


4 (50.0) 


7 (35.0) 


5 (35.7) 


16 (38.1) 


0.59 


0.74 




No 


4 (50.0) 


13 (65.0) 


9 (64.3) 


26 (61.9) 






User training 


Yes 


7 (87.5) 


13 (65.0) 


13 (92.9) 


33 (78.6) 


4.26 


0.11 




No 


1 (12.5) 


7 (35.0) 


1 (7.1) 


9 (21.4) 






Outsourcing 


Yes 


5 (62.5) 


13 (72.2) 


10 (77.0) 


28 (71.8) 


0.51 


0.77 




No 


3 (37.5) 


5 (27.8) 


3 (23.0) 


11 (28.2) 







Values are presented as number (%). 

EMR: Electronic Medical Record, CDSS: Clinical Decision Support System, KMS: Knowledge Management Systems. 



IV. Discussion 

In this study, the status of HIS, effects of EMR/CDSS on 
hospital performance, and changes in management issues 
over time were examined. Adoption rate of EMR has greatly 
increased from 21.4% in 2005 to 77.3% in 2010. Compared 
to rate in 2005, adoption of clinical and managerial DSSs 
has also greatly increased in 2010. Data warehouse was also 
adopted by similar number hospitals (21.9%). Increase in 
adoption of DSSs may be explained by the adoption of EMR 
and data warehouse which provide key information to them. 
Use of an EMR is the first step toward CDSS. 

Factors associated with the adoption of EMR were inves- 
tigated. Hospital size was the only significant factor associ- 
ated with the adoption of EMR. As hospital sizes got bigger, 
the adoption rate of EMR increased to increase efficiency of 
hospital operation and patient management. Robles [12] re- 
ported that EMR improves efficiency of work performance, 
communication among health professionals, thus reduc- 
ing duplicate entries, and speeding-up flow of information. 
Characteristics, such as ownership, location, top manage- 
ment support, and standardization, were not significantly as- 
sociated with the EMR adoption. Hospitals owned by private 
foundation, hospitals located in metropolitan, including 
Seoul, hospitals that have strong top management support, 
and adopted standard terminology showed to have higher 
EMR adoption rates. Strong top management support was 
associated with EMR as hospitals face enormous financial 
challenges in adopting EMR. Poon et al. [13] reported that 



only large institutions could afford to implement EMR be- 
cause of the large upfront investments necessary to deploy 
EMR. Adler-Milstein et al. [14] also reported that large in- 
vestment was the biggest obstacle in the adoption process of 
EMR. 

Unlike EMR, standardization was the only significant factor 
associated with the CDSS adoption. This may be explained 
by the fact that CDSS can be more effectively developed and 
used by clinicians if it is developed based on the standard 
clinical terminologies. Top management support was not 
strongly associated with the adoption of CDSS as it does not 
require large initial investment as EMR. 

Both EMR and CDSS influenced the improvement of hos- 
pital performances. The results are consistent with previous 
studies in EMR and CDSS. EMR improves patient safety and 
quality of clinical services [15]. Florez-Arango et al. [16] 
reported of an increased adherence to guidelines by health- 
care workers using CDSS's on mobile devices in a controlled 
experimental setting. CDSS also reduced serious medication 
error rates by 55% in one study [17]. 

This study also analyzed the temporal changes in HIS de- 
velopment activities and management issues from the very 
beginning of the HIS implementation in order to examine 
whether Nolan's stage theory holds for a hospital setting. 
Adoption rates of EMR and the percentage of outsourcing 
consistently increased as the growth stage increases although 
the association between the two factors was not statistically 
significant. Hospitals in stage 3 also had the highest adoption 
rates of KMS and user training. Ryu and Kim [18] stated that 
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user training is critical to increase computer self-efficacy and 
to maximize the use of information systems. On the other 
hand, hospitals in stage 1 had the highest adoption rates of 
CDSS and standardization. As aforementioned, standardiza- 
tion provides a key infrastructure for CDSS. This finding 
suggests that hospitals are likely to adopt information sys- 
tems to increase efficiency in hospital management and that 
they increasingly emphasize importance of HIS management 
as they have more experience of implementing HIS. 

There were several limitations to this study. There were 
some missing values in user training and outsourcing vari- 
ables. Future research should increase the number of respon- 
dents by including face-to-face interviews in addition to the 
mail-out surveys. In addition, more in depth study should 
be conducted to accurately segment hospitals into growth 
stages as some initial conditions adapted from Nolan's study 
do not perfectly suit with the conditions of Korean hospitals. 
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